Appln.No. 10/617,231 
AMENDMENTS TO THE CLAIMS 



The following listing of claims rqjlaces all prior revisions and listings, of claims in the 
present application. 
LISTING OF CLAIMS 

1 . (Currently Amended) A method of refining a vision system comprising: 

obtaining image intensity data of a field of view and a depth map of objects within the 
field of view; 

determining if the image intensity data and the depth map include information related to a 

target; 

searching for th e top of th e targ e t in the image int e nsity data using information in th e 
depth map, which is align e d to th e imag e int e nsity data; 

searching for vertical edges of the target in the image intensity data using information in 
the depth map; and 

searching for the bottom of the target in the image intensity data using information in the 

depth mapT ; and 

searching for the top of the target in the image intensity data using information in the 
depth map, which is aligned to the image intensity datav. wherein said searching for the top of the 
target comprises: 

(a) searching a row of the depth map data to determine whether a predetermined 

percentage of that row's depth measurements fall within a specified depth; 

(b) storing the position of the row of step (a) if that row has the predetermined percentage 

of depth measurements that fall within a specified depth; 

(c) searching a higher row of the depth map data to determine whether the predetermined 

percentage of that row's depth measurements fall within a specified depth; 

(d) looping to step (h) if the row of step (c) has the predetermined percentage of depth 

measurements that fall within the specified depth; and 
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(e) identifying the highest row that has the predetermined percentage of depth 
measurements that fall within the specified depth as the top of the target. 

2. (Currently Amended) A method according to claim 1, fiirther including comprising 
producing information related to the height and width of the target in the intensity image and 
depth map data. 

3. (Currently Amended) A method according to claim 2, further including comprising 
refining the depth information the target. 

4. (Original) A method according to claim 2 wherein the produced height and width 
information in meters is derived fi"om system calibration parameters. 

5. (Canceled) 

6. (Canceled) 

7. (Canceled) 

8. (Currently Amended) A method according to claim 2 \ wherein searching for the bottom 
of the target includ es comprise searching the lower rows of the image intensity data in the region 
of the detected target to find a dark-to-light transition. 

9. (Original) A method according to claim 8 wherein the bottom of the target is set at a 
predetermined position if a dark-to-hght transition is not found. 

1 0. (Currently Amended) A method according to claim & I fiirther including comprising : 

searching for the vertical edges by: 

searching for a pair of vertical image edges within the image intensity data; 

determining if the found pair of vertical image edges are located at about the same depth; 

and 
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determining if the vertical image edges that are located at about the same depth are the 
strongest pair of vertical image edges, with the strength of a pair being the sum of the pixel 
intensity differences multiplied by a penalty term that reflects the difference in depth; and 

searching for the bottom of the target by searching lower rows of the image intensity data 
to find a dark-to-light transition. 

1 1 . (Currently Amended) A method of refining a vision system comprising: 

obtaining image intensity data fi"om a field of view, a depth map of objects within the 
field of view, and initial boundary information related to a target; 

{b) mapping the initial boimdary information onto the image intensity data and onto the 

depth map; 

(o) s e arching n e ar th e mapp e d initial targ e t boundary of th e imag e int e nsity data and of 
the d e pth map to find th e top of th e targ e t; 

(d) searching near the mapped initial target boundary of the image intensity data and of 
the depth map to find vertical edges of the target; esid 

(e) searching near the mapped initial target boundary of the image intensity data and of 
the depth map to find the bottom of the targetr ; and 

searching near the mapped initial target boundary of the image intensity data and of 

the depth map to find the top of the target, wherein said searching for the top of the target 
comprises: 

(a) searching a row of the mapped depth map data to determine whether a predetermined 

percentage of that row's depth measurements fall within a specified depth; 

(b) storing the position of the row of step (a) if that row has the predetermined percentage 
of depth measurements that fall within a specified depth; 

(c) searching the next higher row of the mapped depth map data to determine whether the 

predetermined percentage of that row's depth measurements fall within a specified depth; 

(d) looping to step (h) if the row of step (c) has the predetermined percentage of depth 

measurements that fall within the specified depth; and 

(e) identifying the highest row of the mapped depth map data that has the predetermined 
percentage of depth measurements that fall within the specified depth as the top of the target. 
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12. (Currently Amended) A method according to claim 11, fUrther including comprising 
using the mapped initial target boundary in the image intensity data and in the mapped depth 
map to refine the target's position. 

13. (Currently Amended) A method according to claim 11, further including comprising 
producing information related to the height and width of the target. 

14. (Canceled) 

15. (Canceled) 

16. (Canceled) 

17. (Currently Amended) A method according to claim 1 1 wherein searching for the bottom 
of the target includ e s comprise searching lower rows of the mapped image intensity data to find a 
dark-to-light transition. 

18. (Original) A method according to claim 17 wherein the bottom of the target is set at a 
predetermined position if a dark-to-light transition is not found. 

1 9. (Currently Amended)A method according to claim 44 IJ. further including comprising : 

searching for the vertical edges by: 

searching for a pair of vertical image edges within the mapped image intensity data; 
determining if a found pair of vertical image edges are located at about the same depth; 

and 

determining if the vertical image edges that are located at about the same depth are the 
strongest pair of vertical image edges, with the strength of a pair being the simi of the pixel 
intensity differences multiphed by a penalty term that reflects the difference in depth; and 

searching for the bottom of the target by searching lower rows of the mapped image 
intensity data to find a dark-to-light transition. 
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20. (Currently Amended) A method of refining a vision system according to claim 1 1 
wherein finding the top of the target includ e s comprises : 

analyzing a bottom row of the mapped initial boundary information in the depth map data 
to determine whether a predetermined percentage of the bottom row's depth measurements fall 
within a predetermined specified region around the target's depth; 

analyzing each consecutive higher row until the topmost row having the predetermined 
percentage of depth measurements that fall within the predetermined specified region around the 
target's depth is found; and 

relating that topmost row to the top of the target. 

21. (Currently Amended) A method of refining a vision system according to claim 11 
wherein finding the vertical edges of the target includ e s comprises searching near the mapped 
initial boundary information of the image intensity data to find vertical image edges that are 
located at about the same depth. 

22. (Currently Amended) An apparatus for refining a vision system comprising: 

means for obtaining image intensity data from a field of view, a depth map of objects 
within the field of view, initial boundary information related to a target, and system calibration 
parameters; 

means for mapping the initial boundary information onto the image intensity data and 
onto the depth map; and 

means for determining from the mapped image intensity data and from the mapped depth 
map whether the specified portion of the initial target boundary is wholly within the field of 
viewT . said means for determining comprising means for searching to find top of the target 
comprising means for analyzing the bottom row of the mapped initial boundary information of 
the depth map data to determine whether a predetermined percentage of the bottom row's depth 
measurements fall within a predetermined specified region around the target's depth, means for 
analyzing each consecutive higher row until the topmost row having the predetermined 
percentage of depth measurements that fall within the predetermined specified region around the 
target's depth is found and means for relating the topmost row to the top of the target. 
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23. (Currently Amended) The apparatus according to claim 22, further including comprising 
means for using the mapped initial target boundary of the image intensity data and of the depth 
map to refine information related to the target's position. 

24. (Canceled) 

25 (New) The apparatus of claim 22 wherein said means for determining further comprising 
means for searching to find bottom of the target. 

26 (New) The apparatus of claim 22 wherein said means for determining further comprising 
means for searching to find vertical edges of the target. 

27 (New) A method of refining a vision system comprising: 

obtaining image intensity data of a field of view and a depth map of objects within the 
field of view; 

determining if the image intensity data and the depth map include information related to a 

target; 

searching for the top of the target in the image intensity data using information in the 
depth map, which is aligned to the image intensity data; 

searching for the bottom of the target in the image intensity data using information in the 
depth map; and 

searching for vertical edges of the target in the image intensity data using information in 
the depth map; wherein said searching for the vertical edges of the target comprises searching for 
a pair of vertical image edges within the image intensity data, determining if the found pair of 
vertical image edges are located at about the same depth, and determining if the vertical image 
edges that are located at about the same depth are the strongest pair of vertical image edges, with 
the strength of a pair being the sum of the pixel intensity differences multiplied by a penalty term 
that reflects the difference in depth. 



28. (New) The method according to claim 27 wherein searching for the vertical edges further 
comprises determining if the vertical image edges that are located at about the same depth and 
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that are the strongest pair of vertical image edges meet maximum and minimimi strength 
constraints. 

29. (New) A method of refining a vision system comprising: 

obtaining image intensity data from a field of view, a depth map of objects within the 
field of view, and initial boundary information related to a target; 

mapping the initial boundary information onto the image intensity data and onto the 
depth map; 

searching near the mapped initial target boundary of the image intensity data and of the 
depth map to find the top of the target; 

searching near the mapped initial target boundary of the image intensity data and of the 
depth map to find the bottom of the target; and 

searching near the mapped initial target boundary of the image intensity data and of the 
depth map to find vertical edges of the target, wherein said searching for the vertical edges of the 
target comprise searching for a pair of vertical image edges within the mapped image intensity 
data, determining if a found pair of vertical image edges are located at about the same depth, and 
determining if the vertical image edges that are located at about the same depth are the strongest 
pair of vertical image edges, with the strength of a pair being the sum of the pixel intensity 
differences multipUed by a penalty term that reflects the difference in depth. 

30. (New) The method according to claim 29 wherein searching for the vertical edges fiirther 
comprises determining if the vertical image edges that are located at about the same depth and 
that are the strongest pair of vertical image edges meet maximum and minimum strength 
constraints. 
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